Skip to content

Document research evidence and drift decision logic - #23

Merged
CoreyLeath-code merged 4 commits into
mainfrom
agent/research-readme-evidence
Aug 13, 2026
Merged

Document research evidence and drift decision logic#23
CoreyLeath-code merged 4 commits into
mainfrom
agent/research-readme-evidence

Conversation

@CoreyLeath-code

@CoreyLeath-code CoreyLeath-code commented Aug 13, 2026

Copy link
Copy Markdown
Owner

Summary

  • replace redundant badge blocks with workflow-status and source-backed evidence badges
  • add an explicit PSI/KS drift-decision specification mapped to the C++ implementation
  • report the committed benchmark results with workload and synthetic-data scope
  • correct the quickstart to use the repository's Python benchmark and C++ build command

Evidence boundaries

The reported latency and throughput are for the seeded Python reference workload. The F1 result is limited to deliberately separated synthetic perturbations; it is not presented as production accuracy.

Validation

Verified README badge references, display-math delimiters, thresholds, formulas, and reported p95/F1 values against drift-engine/drift_engine.cpp and benchmarks/latest.json.

Summary by CodeRabbit

  • Documentation
    • Updated the README with a reproducible drift-monitoring overview.
    • Documented PSI and KS calculations, drift thresholds, benchmark scope, evidence, research questions, and limitations.
    • Revised local validation instructions to run the Python benchmark and compile the C++ engine directly.
    • Clarified the architecture as separating inference and telemetry layers locally.

@coderabbitai

coderabbitai Bot commented Aug 13, 2026

Copy link
Copy Markdown

Review Change Stack

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: ff20a596-856d-45bd-91cd-3797bfa695ad

📥 Commits

Reviewing files that changed from the base of the PR and between 9fd96c6 and e66a6d1.

📒 Files selected for processing (1)
  • README.md

📝 Walkthrough

Walkthrough

README.md now presents SentinelAI as a reproducible drift-monitoring project. It documents PSI/KS evaluation, benchmark evidence, local validation commands, limitations, and a factual architecture description.

Changes

Reproducibility documentation

Layer / File(s) Summary
Drift monitoring scope and evidence
README.md
The README defines PSI and KS calculations, drift thresholds, benchmark scope, research questions, evidence, and production-readiness limitations.
Local validation and architecture instructions
README.md
The README replaces CMake/CTest instructions with direct Python benchmark and C++ engine commands. It also describes separation between inference, telemetry, and evaluation layers.

Estimated code review effort: 2 (Simple) | ~10 minutes

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch agent/research-readme-evidence

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@CoreyLeath-code
CoreyLeath-code marked this pull request as ready for review August 13, 2026 00:50
@CoreyLeath-code
CoreyLeath-code merged commit 7e9b55f into main Aug 13, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant